MORD: Multi-class Classifier for Ordinal Regression

نویسندگان

  • Kostiantyn Antoniuk
  • Vojtech Franc
  • Václav Hlavác
چکیده

We show that classification rules used in ordinal regression are equivalent to a certain class of linear multi-class classifiers. This observation not only allows to design new learning algorithms for ordinal regression using existing methods for multi-class classification but it also allows to derive new models for ordinal regression. For example, one can convert learning of ordinal classifier with (almost) arbitrary loss function to a convex unconstrained risk minimization problem for which many efficient solvers exist. The established equivalence also allows to increase discriminative power of the ordinal classifier without need to use kernels by introducing a piece-wise ordinal classifier. We demonstrate advantages of the proposed models on standard benchmarks as well as in solving a real-life problem. In particular, we show that the proposed piece-wise ordinal classifier applied to visual age estimation outperforms other standard prediction models.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Preference Ranking Model Using a Discriminatively-trained Classifier

This paper presents an ordinal regression approach to the query-by-description problem. Instead of returning a single classification, such as genre, or a list of the top N songs assumed to be relevant, this algorithm mirrors choices similar to "like", "skip", "play", and "hate" buttons seen on commercial Internet radio stations. Ordinal regression can be viewed as a hybrid between multi-class c...

متن کامل

Second Order Cone Programming Formulations for Handling Data with Perturbation

Ordinal regression problem and general multi-class classification problem are important and on-going research subject in machine learning. Support vector ordinal regression machine (SVORM) is an effective method for ordinal regression problem and has been used to deal with general multi-class classification problem. Up to now it is always assumed implicitly that the training data are known exac...

متن کامل

A Multi-class Algorithm Model Based on p-class Support Vector Ordinal Regression Machine∗

Multi-class classification is an important and on-going research subject in machine learning. In this paper, we propose an algorithm model for k-class multi-class classification problem based on p-class (2≤ p≤ k) support vector ordinal regression machine (SVORM). A series of algorithms can be generated by selecting the different parameters p, L and the code matrix. When p = 2, they reduce to th...

متن کامل

Multivariate decoding of brain images using ordinal regression☆

Neuroimaging data are increasingly being used to predict potential outcomes or groupings, such as clinical severity, drug dose response, and transitional illness states. In these examples, the variable (target) we want to predict is ordinal in nature. Conventional classification schemes assume that the targets are nominal and hence ignore their ranked nature, whereas parametric and/or non-param...

متن کامل

Fault diagnosis in a distillation column using a support vector machine based classifier

Fault diagnosis has always been an essential aspect of control system design. This is necessary due to the growing demand for increased performance and safety of industrial systems is discussed. Support vector machine classifier is a new technique based on statistical learning theory and is designed to reduce structural bias. Support vector machine classification in many applications in v...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013